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I. INTRODUCTION 

Amplitude analyses of three-body decays of B mesons with no charm particle in the final state are well 
suited to study the Cabibbo-Kobayashi-Maskawa (CKM) framework [l] for charged current weak interactions. 
In the analysis of a Dalitz plot the strong phases between interfering resonances are measured and can be 
used to constrain the weak phases related to the CKM parameters that, in the Standard Model, govern 
CP- violation. Following the path 0, y, |j| of the 3-pion B meson decays which give constraints on the CKM 
angle acKM = arg(— Vtdl^j/Vudl^*b)i it has been shown in [5, 6] that B decays into a kaon and two pions are 
sensitive to the angle 7ckm = a-^g{-VudV*^/VcdV*f,). 

In this paper we present an amplitude analysis of the flavor-specific i?° -^ K^n^n^ decay [7|]. This 
analysis, an update to an earlier analysis Q , compares the Dalitz plots of the B'^ and B^ decays where Kn 
and TTTT resonances interfere. In addition to enhanced statistics, we utilize improved track reconstruction, 
tagging information from the opposite B, and the measured B flight-time to improve the quality of the 
measurements. Previous measurements of the three-body final state [3,llO| ^^'^ subdecays [lllll3l to a vector 
and a pseudoscalar meson have been published. Other B -^ Knn decays have been studied in [ISl, [ij, |l^, 3. 
A phenomenological study of three-body B meson decays without charm in the final state is presented in ITi] . 

This paper is organized as follows. We first present in Section |II] the decay model based on an isobar 
expansion of the three-body decay amplitude. The complex coefficients of the expansion are the unknowns 
we seek to determine by means of an unbinned extended maximum likelihood fit. We describe the detector 
and dataset in Section Hill the procedure used to select the data sample in Section [TVl and the fit method 
in Section |Vl The results are then described in Section IVII together with the accounting of the systematic 
uncertainties in Section [VIII Finally in Section [VIIIl we summarize our findings. 

II. DECAY AMPLITUDES 

The B'^ —)■ K^TT^TT^ decay amplitude is a function of two independent kinematic variables commonly 
chosen to be the invariant masses squared*, x = m^±^^ and y = rn^j^^^o. The Dalitz plot (DP) is the x, y 
two-dimensional distribution. It is customary to express the decay amplitude as a sum over intermediate 
(isobar) states: 

Ax,y)^^ajfj{x,y), (1) 

j 

and similarly for the B° —> A'^tt+tt^ Dahtz plot, 

A^^y) ^^ajfj{x,y). (2) 

j 

The complex isobar coefficients aj are parameterized by: 

a,=c,(l + 6,)e'(^^+^^) (3) 

a, =c,(l-&,)e^(^^-^^) (4) 



We use natural units where h = c= 1 in our algebraic equations 



and are constant over the Dalitz plot. The parameters bk, ipk, 5k are related to the isobar fractions FF^ 
(CP-averaged over B^ and B^), CP- violation charge asymmetries and phases by: 

pp ^ lDp[\"-kfk{x,y)\'^ + \akJk{x,y)\'^]dx dy 

IdpW Ej o-ifji^'VW + I Y.j'^j7j{x,yW]dx dy 



A 



fc _ iSfep-lofep _ -26fe 
-cp - ^^^^ - ^-^ 



Ofe = <l>k+Sk , 
$fc — (j>k — 5k 

Note that, due to interference, the fractions FF^ in general do not add up to unity. 

The decay dynamics of an intermediate state are specified by the fj{x,y) function which describes the 
Dalitz plot. For instance a resonance formed in the K'^'k~ system gives a contribution which factorizes as: 

/, {x,v)= R, [x] X Tj {x,y)x W, (x) , (6) 

where Rj{x) is the resonance mass distribution or lineshape and Tj{x,y) models the angular dependence. 
The product of Blatt-Weisskopf damping factors, Wj{x) = ^Bb{Rp*{x)) Bj{Rq{x)) [Tgl, slightly deviates 
from unity as a function of x through the breakup momenta^ of the (quasi) two body B and resonance 
decays multiplied by a range parameter R. The fj are normalized, 

\f,ix,y)\^dxdy = l. (7) 

DP 

We use the Zemach tensor formalism [1^, 120] for the angular distribution T- '{x, y) of a process by which 
a pseudoscalar B meson produces a spin- J resonance in association with a bachelor pseudoscalar meson. For 
J = 0, 1, 2, we have: 

3 

Tf" = \[i{p-q)^-{\p\\q\?l (8) 

where^° p{x,y) {q{x)) is the momentum vector of the bachelor particle (the resonance decay product Q 
defined below) measured in the resonance rest frame. For a neutral (charged) Kit resonance, Q is the pion 
(kaon), and for a dipion resonance, Q is the 7r°. Notice that these choices define for each two-body system 
the helicity angle 9j = {pj, (jj) between and n. 

Our nominal model (Table |T| for the decay B^ -^ K^ir^ir'^ includes a nonresonant contribution which is 
uniformly distributed over the Dalitz plot, and seven resonant intermediate states: p~{77Q)K^, p~{lA50)K~^, 
p-{1700)K+, ii:*(892)+'°7r-'° and (i^7r)o+'°7r-^°. The notation for the last isobar component, introduced 
by the BaBAR experiment [131 , denotes phenomenological amplitudes describing the neutral and charged Ktt 
S-waves each by a coherent superposition of an elastic effective range term and a term for the Kq{14:3Q) 
scalar resonance. It describes current knowledge on low energy Ktt systems with a small number of pa- 
rameters. In addition we include two non- interfering components for the decays i3° -^ D n'^ ^ K'^'k~'k'^ 
and B^ -^ D~ K^ -^ K^Tr~Tr^. Variations in the nominal model are used to estimate the model-dependent 
systematic uncertainty in the results. The Gounaris-Sakurai (GS), relativistic Breit-Wigner (RBW), and 
LASS lineshapes are used to model the Rj{x). Parameters are taken from [22] unless stated otherwise. 



^ p* , the momentum of the bachelor particle in the B meson rest frame, is equal to the breakup momentum of the studied B 

meson decay. 
^^ For simplicity, we have dropped the j index in p and q. 
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TABLE I: The nominal model for the decay B" -^ K'^-k~-jy° comprises a nonresonant part and seven intermediate 
states. The three types of lineshape are described in the text. The resonances masses and widths are from [22], 
except for the LASS shape [2l|]. We use the same LASS parameters for both neutral and charged Ktt systems. 
Additional resonances that may contribute are included in extended models which we study to estimate the systematic 
uncertainties. 



Intermediate state 


Lineshape 


Parameters 




Nominal 


'. model 


Nonresonant 


Constant 




p-{770) 


GS 


m = 768.5 MeV/c^ 
r'' = 148.2 MeV 


p~(1450) 


GS 


m = 1439 MeV/c^ 
r° = 550 MeV 


p-(1700) 


GS 


m = 1795 MeV/c^ 
r" = 278 MeV 


A-*+(892) 


RBW 
RBW 






LASS 


m° = 1415 ± 3 MeV/c^ 

r" = 300 ± 6 MeV 

cutoff mf" ^ = 1800 MeV/c^ 

a = 2.07 ±0.10 (GeV/c)-i 

r = 3.32 ±0.34 (GeV/c)-i 



Non-interfering Components 
D mass = 1862.3 Double Gaussian 
width = 7.1 MeV/ c^ (From Data) 



D^ 



mass = 1864.4 
widf^ = 9.9MeV/c^ 



Double Gaussian 
(From MC) 



Additional resonances 



ii:2*(1430)+'° 
K*{1680)+'" 



RBW 

RBW 



A. LINESHAPES 



1. The relativistic Breit-Wigner distribution 



The relativistic Breit-Wigner (RBW) parameterization is used for K*{892)+'°, K2{l'i30)+'", and 
K*{1680)+'°: 



Ry\x;m,,T"^) 



— X — imjT ■ (x) 



(9) 



The mass-dependence of the total width T, ' can be ignored for high-mass states. For the low-mass states 
which decay only elastically, it is defined by 



.(J) 



rr^(-) - r;;^ 



„m, I q{x) V''^' B^-'\Rq{x)) 



X \q{m^j) BiJ){Rq{m))) ' 



(10) 
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where ruj is the mass of the resonance j, r° = Tj{m'^) its width, and the barrier factors (squares of the 
Blatt-Weisskopf damping factors [l^) are: 

B(") = 1, (11) 



1 + i?2g2 ' 



S(2) = 



1 



9 + 3i?2q2 _^ Ji4q4 ■ 
All range parameters (R) are set to the values in the PDG [23 |. 



2. The Gounaris-Sakurai distribution 



The Gounaris-Sakurai (OS) parameterization [2^ is used for p (770), p (1450) and p (1700): 



771 



+ gj {x) — X — irrijTj (x) ' 



with the same x-dependence of the width as for the RBW. The expressions of the constant dj and the 
function gj{x) in terms of 77ij and T^ are given in ^23i] . The parameters of the p lineshapes are taken from r 
and nn scattering in [2J| and [25J . 

3. The LASS distribution 

For the Kn S'-wave amplitudes, (Kir)'^^ , which dominate for mxTr below m"^°-^ = 2 GeV/c^, an effective- 
range parameterization was suggested [26] to describe the slowly increasing phase as a function of the Kt: 
mass. We use the parameterization as in the LASS experiment [21| , tuned for B decays: 

R'^^^^ix-mlTla^r) = f . (13) 

ip^i^B J 3 go 

where 

cotfe = — r^ + -;^rg(x), (14) 

a is the scattering length, and r the effective range (Table H]). 

B. THE SQUARE DALITZ PLOT 

The accessible phase space for charmless three-body B decays is unusually large. Most contributing 
resonances have masses much lower than the B mass. Hence signal events cluster along the Dalitz plot 
boundaries. This is also true for background events. Past experience has shown that another set of variables, 
defining the Square Dalitz Plot (SDP) is well suited to such configurations. It is defined by the mapping: 

dx dy — > dm' de' (15) 

777 = — arccos(2 1) , c' = —0, 
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FIG. 1: The standard (a) and square (b) Dalitz plots of the selected data sample of 23683 events. The selection 
criteria are described in Sec. IIVI . The structures are more spread out in the square Dalitz plot. The D' 
narrow band is preserved with the choice made for the m' variable. 



■0 



K^ 



where m — ^/x and 6 are respectively the invariant mass and helicity angle of the K n^ system, mmax ~ 
niB — rii^o and ?7imin — 'm'K+ + "^tt- £^re the kinematic Hmits of m. The new variables both range between 
and 1. The standard and square Dalitz plots are shown for our data sample in Fig. [1] 



III. THE BABAR DETECTOR AND DATASET 



The data used in this analysis were collected with the BaBAR^ detector at the PEP-II asymmetric energy 



=+. 



e ' e storage rings between October 1999 and September 2007. This corresponds to an integrated luminosity 

of 413 fb^^ or approximately Ngg 

-1 



454 ± 5 million BB pairs taken on the peak of the T(4S') resonance 
(on resonance) and 41fb~^ recorded at a center-of-mass (CM) energy 40 MeV below (off resonance). 

A detailed description of the BaBAR detector is given in [23|. Charged-particle trajectories are measured by 
a five-layer, double-sided silicon vertex tracker (SVT) and a 40-layer drift chamber (DCH) coaxial with a 1.5 T 
magnetic field. Charged-particle identification is achieved by combining the information from a ring-imaging 
Cherenkov device (DIRC) with the ionization energy loss (dE/dx) measurements from the DCH and SVT. 
Photons are detected in a CsI(Tl) electromagnetic calorimeter (EMC) inside the coil. Muon candidates are 
identified in the instrumented fiux return of the solenoid. We use GEANT4-based 28] software to simulate 
the detector response and account for the varying beam and environmental conditions. Using this software, 
we generate signal and background Monte Carlo (MC) to estimate the efficiency and expected backgrounds 
in this analysis. Two samples of signal MC were used: one was generated with the Dalitz plot distribution 
observed in the previous analysis [8j while the other was generated with a phase-space distribution. 



IV. EVENT SELECTION 



SIGNAL SELECTION AND BACKGROUND REJECTION 



To reconstruct B° — » K~^n~Tr° decays, we select two charged particles and two photons. The charged 
particle candidates are required to have transverse momenta above 100 MeV/c and at least 12 hits in the 
DCH. They must not be identified as electrons or muons or protons. We select kaons and pions based on 
their signatures in the DIRC and DCH. The 7r° candidate is built from a pair of photon candidates, each 
with an energy greater than 50 MeV in the laboratory frame (LAB) and a lateral energy deposition profile 
in the EMC consistent with an electromagnetic shower. The invariant mass of a 7r° candidate must satisfy 
1^^^^^=^^ — ™PDG I ^ ^ -y^g ,^Yqo require | cos0*o|, the modulus of the cosine of the angle the decay photons make 

with the TT^ momentum vector to be less than 0.95 . 

At the T(4S') resonance, B mesons are characterized by two nearly independent kinematic variables, the 
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beam energy substituted mass and the energy difference: 



^ES - •^{s/2+ph-phf/El^pl, (16) 

l^E ^ E*B- ^/i/2, (17) 

wlrere E and p are energy and momentum, the subscripts and B refer to the e^e~-beam system and the 
B candidate respectively; s is the square of the center-of-mass energy and the asterisk labels the CM frame. 
We require that 5.272 < toes < 5.2875 GeV/c^. To avoid a bias in the Dalitz plot from the dependence on 
the TT^ energy of the resolution in A_E, we introduce the dimensionless quantity: 

+ TTio + mix + m2X + 77130: 

AE' = ^^^ 5 (18) 

Wo + WiX + W2X'' + w^x-^ 

where the coefficients are determined from fits to signal MC and x — m^±^^. We require |Ai?'| < 2.1. 

Continuum e^e" ^* 99 (9 = u,d,s,c) events are the dominant background. To enhance discrimination 
between signal and continuum, we select events by using a neural network [29l] with an output NN which 
combines six discriminating variables: the angles of the B momentum and the B thrust axis with respect 
to the e+ beam direction in the CM frame, the angle between the thrust axes of the signal B and other B, 
the zeroth and second order monomials Lq and L2, and Az/cr(Az), the flight distance between the two Bs 
scaled by the error. The monomials are defined as L„ = X^i P« ' I *-<^^ ^«l"' where the sum runs over all charged 
and neutral particles in the event (except for those in the B candidate) whose momenta pi make angles 9i 
with the B thrust axis. The neural network was trained on off resonance data and correctly reconstructed 
signal Monte Carlo events. We require 0.6 < NN. 

Approximately 15% of the signal events have multiple reconstructed B candidates (usually two). We select 
the candidate with the minimum value of: 

X =( ) +XVertox- (19) 

where Xvortcx i^ the x^ of the kinematic fit to the particles in the B meson candidate. 

There are 23268 events in the data sample after the selection. The B meson candidate in each event is 
mass constrained to ensure that the measurement falls within the Dalitz plot boundary. 

B. TRUTH-MATCHED AND SELF-CROSS-FEED SIGNAL EVENTS 

Using the Monte Carlo simulation as in Q, we distinguish between the correctly reconstructed and the 
misreconstructed signal events. A correctly reconstructed event where the three particles of the B candi- 
date match the generated ones, is called a Truth-Matched (TM) event. The TM PDFs describe correctly 
reconstructed events in the fit to data. A misreconstructed signal event contains a B meson which decays 
to the signal mode, but one or more reconstructed particles in the B candidate are not actually from the 
decay of that B. Misreconstructed signal is called Self- Cross- Feed (SCF). Misreconstruction is primarily 
due to the presence of low momentum pions. Consequently the efficiency e{m' , 9') to reconstruct an event 
either correctly or incorrectly varies across the Dalitz plot. The SCF fraction /scf('ti', 9') is high, where the 
quality of the reconstruction is poor. This occurs in the corners of the Dalitz plot where one of the final-state 
particles has a low momentum in the LAB frame. These variations can be seen in Fig. [5] computed using 
high statistics Monte Carlo samples. It is important to keep a high efficiency in the Dalitz plot corners where 
the low-mass vector resonances interfere. Overall the total efficiency is close to 22.5% and the SCF fraction, 
averaged over the Dalitz plot, is ~ 9%. 
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FIG. 2: Selection efficiency for truth-matched events on the left and SCF events on the right. 



C. BACKGROUND 

1. Continuum background 

Although the neural network selection rejects 90% of the continuum events, this background is the domi- 
nant class of events in the data sample, representing about two thirds of its size. 

2. Background from other B decays 

Since there is no restriction on any two-body invariant mass of the final state particles, large backgrounds 
from other B decays occur. We use high statistics Monte Carlo samples to study these backgrounds. Conser- 
vative assumptions about unknown branching fractions are made. Inclusive and exclusive B decays with or 
without charm are grouped into nineteen classes to be used in the fit. Rates, and topological and kinematical 
similarities are studied to define the classes listed in Table |lTl Those backgrounds whose contributions are 
expected to be large (200 or more events) are varied in the fit while all others are fixed. 

V. THE MAXIMUM LIKELIHOOD FIT 

We perform an unbinned extended maximum likelihood fit to determine the total B^ — » K'^tt^t:^ event 
yield, the magnitudes Cj{\ ± hj) and phases (pj ± 5j of the complex isobar coefficients of the decay amplitude 
defined in Eq. [3] The fit uses the variables to', 9' , tties, A_E' and NN to discriminate signal from back- 
ground. A simultaneous fit is performed using the B-tagging [SOl category from the opposite B, for a further 
im pro vement in discriminating power. The variable label c denotes each of seven tagging categories defined 
in 13011 ■ 



THE LIKELIHOOD FUNCTION 



The selected on-resonance data sample consists of signal, continuum-background and background from 
other B decays. The probability density function (PDF) Vf for an event i in tagging category c is the sum 
of the probability densities of all components, namely 
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TABLE 11: The list of _B-backgrounds retained for the fit (Section |V|. For each channel, we give (anticipating Sec- 
tion IVI|) either the fitted number of events in the data sample if its yield is allowed to vary in the fit procedure or 
the expected number otherwise. 



Class Mode 


Events 




1 


B" -^ K*"{S92)'Y,K''"{U30h 


187 ±14 


fixed 


2 


p+^« 


11 ±2 


fixed 


3 


/o(980)A:+, K'+tt", 


48 ±12 


fixed 


4 


K'+K- 


14 ±10 


fixed 


5 


7r+7r~7r'^ Dalitz plot 


8±1 


fixed 


6 


_K'^7r~7r+ Dalitz plot 


164 ±9 


fixed 


7 


if+^« 


65 ±3 


fixed 


8 


K+^- 


53 ±2 


fixed 


9 


7r+7r~7r'' Dalitz plot 


109 ± 13 


fixed 


10 


Generic B -^ charm with D" 


627 ± 60 varied 


11 


Generic B -^ charm with D^ 


370 ± 80 varied 


12 


K*+a^, K*°p°, 


9±2 


fixed 


13 


K'^rj'K~ , 


8±1 


fixed 


14 


V'K+, 


22 ±1 


fixed 


15 


p+p-,a+7V- 


27 ±3 


fixed 


16 


K'''p+, 


15 ±6 


fixed 


17 


K'+p-, 


21 ±6 


fixed 


18 


p+p°,al7T+,at^° 


50 ±13 


fixed 


19 


Combinatoric B Decays 


660 ± 122 varied 



v^ 



NsiJs% (1-7scf)^> 



sig-TM,i 



/sCF^si 



SCF' sig-SCF,J 



+ N^gT;i^ + Qt.saAqg,t.s)K 



E 



Nej/b,] 0(1 + 9tag,z^B, tagj) T'b^, 



(20) 

where iVgig is the total number of S" -^ K^tt^tt^ signal events in the data sample; f^^„ is the fraction of signal 
events that are tagged in category c; /gcF i^ the fraction of SCF events in tagging category c, averaged over 
the DP; 'Pg^ig^xM i ^^'^ ^sio^-sCF i ^-^^ the products of PDFs of the discriminating variables used in tagging 
category c for TM and SCF events, respectively; N^^ is the number of continuum events that are tagged in 
category c; ^tag.i is the tag flavor of the event, and is equal to the charge of the kaon from the B decay; 
^gg, tag parameterizes possible tag asymmetry in continuum events; V^^ j is the continuum PDF for tagging 
category c; -/V^fass i^ the number of B-related background classes considered in the fit, namely nineteen; Nb,j 
is the number of expected events in the B background class j; f% ■ is the fraction of B background events 
of class j that are tagged in category c; Ab. tag.j describes a possible tag asymmetry in the B background 
class j] Vg j. is the i?-background PDF for tagging category c and class j. 

The PDFs Vx (X = {sig-TM, sig-SCF, qq, B) are the product of the four PDFs of the discriminating 
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TABLE III: Summary of the PDF parameterizations. G=Gaussian, Pl=lst order polynomial, NP=non-parametric. 
The notation (DP) designates a PDF with parameters which vary over the Dalitz plot. The Dalitz plot signal model 
is described in Section HTl 



Component 


rriEs 


AE' 


NN 


Dalitz 


signal (TM) 


see text 


G(DP)+P1(DP) 


NP 


see text 


signal (SCF) 


NP 


NP 


NP 


see text 


Continuum 


Argus 


PI 


see text 


NP 


B backgrounds 


NP 


NP 


NP 


NP 



variables "'^'^, a;i = rriES, X2 = AE' , x^ = NN output and the doublet Xi = {m' , 9'}: 



4 



XAJ) - 

k=l 



n^x.a)(^fc)' (21) 



where i is the event index and j is a. B background class. The extended likelihood over all tagging categories 
is given by 

7 _ T^" 

c— 1 i 

where N is the total number of events expected in category c. 

The correlations among the measurements are handled by building conditional PDFs where appropriate. 
The PDF parametizations are given in Table lllli and a summary of the parameters varied in the fit can be 
found in Section V.D. 

B. THE DALITZ PROBABILITY DENSITY FUNCTIONS 

Since the decay B'~' -^ K^tt^tt'-' is flavor-specific (the charge of the kaon identifies the b flavor), the B^ 
and B'-* Dalitz plots are independent. However, because the backgrounds are essentially flavor blind, we get 
a more robust procedure by fitting them simultaneously. It is enough to describe only the B'^ Dalitz plot 
PDF. A change from A to A (Eq. ^ and ^) accompanied by the interchange of the charges of the kaon 
and pion gives the B^ PDF. 

1 . Signal 

The model for the distribution of signal events in the Dalitz plot has been described in Section |TT1 The 
free parameters are Cj , bj , (pj , Sj defined in Eq. ^ and ([2]) for all the intermediate states of the signal 
model given in Table HI Since the measurement is done relative to the p~(770) final state, the phases of this 
and the charge conjugate channels are fixed to zero. The amplitude of i?° — > p~{770)K'^ is also fixed but 
not that of S" — > p^{770)K^ in order to be sensitive to direct CP- violation. The weak phase Sj and CP 
violating amplitude bj of the p^{l450) and p~(1700) are constrained to equal those of the p^{770) in the 
fit. 

The normalization of the component signal PDFs: 

rTM,^ (X £.(1 - /scF,^)|detJi||A|', (23) 



^^ Not all the PDFs depend on the tagging category. The general notations PJ. ., ., and T-'J- ., .. are used for simplicity. 
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PscF,, (X eJscFA\<ietJ\\A\'' Rscf^, (24) 

is model dependent. J7 is the Jacobian matrix of the mapping to the square Dahtz plot. The symbol (E) 
stands for a convolution and the R matrix is described below in Eq. (|29p . The normalization requires the 
computation of the integrals 

1 .1 

dm' de' e{l-fscF)\detJ\fkn, (25) 

Jo 

f dm' f d9' efscF\detJ\fkf;, (26) 

Jo Jo 

and 

1 rl 

dm' / de' e\detj\fkfi*, (27) 

Jo 

where the notations of Eq. ([1]) are used. The integrations over the square Dalitz plot are performed 
numerically. The weight 

J ^ !,' dm' J^' de' efscFldet J\\A\' 
^^^ J^ dm' f^ d9' e\detJ\\A\^ 

ensures that the total signal PDF is normalized. The PDF normalization depends on the decay dynamics 
and is computed iteratively. In practice the computation of fscF rapidly converges to a value which we fix 
after a few exploratory fits. 

Studies in simulation have shown that the experimental resolutions of m' and 9' need not be introduced in 
the TM signal PDF. However, misreconstructed events often incur large migrations, when the reconstructed 
m!j.,6'^ are far from the true values m'^,9'^. We use the Monte Carlo simulation to compute a normalized 
two-dimensional resolution function RscFim'j., 0^; mj, 0j), with 

/ dm; / d9'^RscF{m'^,9'^;m't,9't) = 1. (29) 

Jo Jo 

RscF is convolved with the signal model in the expression of Vscf in Eq- (|24|) . 

2. Background 

Except for events coming from exclusive B ^ D decays, all background Dalitz PDF are modeled with 
non-parametric, smoothed, two-dimensional histograms. The continuum distributions are extracted from a 
combination of off resonance data and a sideband (5.20 < tties < 5.25GeV/c^) of the on-resonance data 
from which the i?-background has been subtracted. The square Dalitz plot is divided into eight regions 
where different smoothing parameters are applied in order to optimally reproduce the observed wide and 
narrow structures by using a two-dimensional kernel estimation technique [3l|. For 0.64 < m' < 0.66 and 
all 9', a finely binned, unsmoothed histogram is used to follow the peak from the narrow Z?*^ continuum 
production. The B-background (Table [TH) Dalitz PDFs are obtained from the Monte Carlo simulation. For 
the components which model 6 — > c decays with real Z?° mesons, a fine grained binning around the D mass 
is used to construct unsmoothed histograms. 

C. THE OTHER PDFS 

1 . Signal 
The Toes distribution for signal events is parameterized as: 



/(X = TTIES) = CXp 



(x- 



2a j. + a±{x — m)2 
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(30) 



where m and a± are floated in the data fit. 

For SCF-signal events we use a non-parametric shape taken from the Monte Carlo simulation. 

AE' is correlated with the Dalitz plot variables for TM-signal events. To account for the correlation, we 
choose the combination of a Gaussian and 1st order polynomial PDF. The mean and standard deviation 
of the Gaussian and slope of the polynomial vary linearly with m^±^:p. These parameters (intercept and 
slope) are free in the fit. A non-parametric shape taken from the Monte Carlo simulation is used for the 
SCF-signal AE' PDF. 

The NN PDFs for TM and SCF events are non-parametric distributions taken from the Monte Carlo. 



We use the Argus function [32 



2. Background 



/(z = -^) .X ^VT^e-^^^-^'^ (31) 



as the continuum toes PDF. The endpoint m^g^ is fixed to 5.2897 GeV/c^ and ^ is free in the fit. The AE' 
PDF is a linear polynomial whose slope is free to vary in the fit. The shape of the NN distribution for 
continuum is correlated with the event location in the Dalitz plot. To account for that effect we use for the 
NN PDF a function that varies with the closest distance A^aUtz between the point representing the event 
and the boundary of the standard Dalitz plot, 

7'(A^A^;Adaiitz)= (l-iViV)'^^ (32) 

x{k2NN^ + k3NN + ki). 

h ^ Qi+Pi- Adalitz 

The ki are linear functions of Ajaiitz where the qi and pi are varied in the likelihood fit. 

We use non-parametric distributions taken from the Monte Carlo to describe toes, Ai^'and NN distribu- 
tions for the i?-background classes in Table [III 

D. THE FIT PARAMETERS 

The following parameters are varied in the fit: 

• Yields for signal (Ngig), continuum (Nqq) and three B background classes (c=10, 11 and 19 defined 
in Table HH. 

• CP-asymmetries for the continuum events. 

• The global mean and slopc(s), of the AE' distribution for the TM-signal (continuum) events. 

• Parameters which describe the shape and correlation of the NN output and the event location in the 
Dahtz plot [Eq. ([5^]. 

• The mean and widths of the function describing the tties distribution of the TM-signal events in 
addition to the ^ parameter of the Argus function describing the continuum toes shape. 

• Thirty-two isobar magnitudes and phases. There are 10 intermediate states (7 resonances and a non- 
resonant term and two non-interfering D modes) and two Dalitz plots. We fix one reference magnitude, 
that of i?° — > p~{77Q)K^ and two phases for the latter and its conjugate. Therefore we end up with 
18 magnitudes and 14 phases to be determined by the fit. 
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VI. RESULTS 

The maximum likelihood fit results in a S" -^ K^tt^tt'^ event yield of Ngig = 4583 ± 122 events, where 
the uncertainty is statistical only. When the fit is repeated starting from input parameter values randomly 
chosen within wide ranges of one order of magnitude above and below the nominal values for the amplitudes 
and within the [— tt, tt] interval for the phases, we observe convergence toward four solutions with minimum 
values of the negative loglikelihood function (NLL). The best solution is separated by 3.9 units of NLL from 
the next best solution. The event yield we quote is for the best solution; the spread of signal yields between 
the four solutions is less than 5 events. The fitted phases $, <i> and the CP-asymmetries Acp are given for 
the best solution in Table HVl 



TABLE IV: Results of the best solution. The fractions are the CP-averaged isobar fractions {FFk) defined with the 

CP-asymmetries Acp in Section |II][Eq. ((5)l]. The phases "1> for the P" decays and $ for the P'' decays are measured 
relative to P (P'^) — > p^K . The first error is statistical and the second is systematic. 

Isobar Fraction (%) <I> ^ Acp 

p- {nQ)K+ 13.60 ± 1.24 ± 0.60 0.00 (fixed) 0.00 (fixed) 0.14 ± 0.06 ± 0.01 

p"(1450)/s:+ 4.66 ±1.42 ±0.68 1.63 ± 0.26 ± 0.12 1.63 ± 0.26 ± 0.12 0.14 ± 0.06 ± 0.01 

p {nQO)K+ 1.16 ±0.69 ±0.26 0.52 ± 0.40 ± 0.15 0.52 ± 0.40 ± 0.15 0.14 ± 0.06 ± 0.01 

is'*+(892)7r- 5.52 ±0.59 ±0.18 0.74 ± 0.36 ± 0.14 0.37 ± 0.36 ± 0.31 -0.30 ± 0.11 ± 0.03 

_K'*°(892)7r° 4.53 ±0.57 ±0.26 0.65 ± 0.29 ± 0.10 -0.00 ± 0.33 ± 0.10 -0.15 ± 0.12 ± 0.02 

{K-n)l+-K- 23.60 ±1.18 ±1.70 -2.76 ± 0.25 ± 0.08 -2.60 ± 0.30 ± 0.22 0.07 ± 0.05 ± 0.01 

{K-K)f-K° 11.90 ±1.11 ±1.46 0.37 ±0.26 ±0.38 -0.11 ± 0.27 ± 0.24 -0.16 ± 0.09 ± 0.04 

N.R. 5.90 ±0.93 ±0.80 1.00 ± 0.24 ± 0.17 1.15 ± 0.27 ± 0.18 0.07 ± 0.15 ± 0.04 
P°7r° 20.90 ± 0.85 ± 2.66 
D-K+ 0.93 ±0.23 ±0.02 



The Dalitz plot mass distributions in an enlargement of the low-mass resonance region (masses below 
2.0 GeV/c^) are shown in Fig. [3]. The p~, _ftr*+, and X*° are clearly visible in the m^-^o, niji+j^o, mx+iT- 
distributions respectively. We calculate a x^ of 772 for 644 bins on the Dalitz plot where at least 25 events 
are guaranteed to exist in each bin. The distributions of the discriminating variables (m-ESi ^E and NN) 
are shown in Fig. [4] Fitted parameters are given for the four solutions in Table |Vl We observe that the 
fit fractions and the CP asymmetries are consistent within less than three standard deviations among the 
solutions, though the phases differ substantially. 
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FIG. 3: Mass distributions for: mj^+^- (a), rrij^+^a (b) and m^-^a (c). The data are shown as points with error bars. 
The solid histograms show the projection of the fit result. The blue (dark) and red (gray) shaded areas represent the 
B background and continuum, respectively. 
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FIG. 4: (a) tties, (b) AB'and (c) NN distributions. The data are shown as points with error bars. The solid 
histograms show the projection of the fit result. The blue (dark) and red (gray) shaded areas represent the B 
background and continuum, respectively. 
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TABLE V: Results of the four solutions of the fit. The fractions are the CP-averaged isobar fractions (FFk) defined 
with the CP-asymmetries Acp in Section |Tl] [Eq. ©] . The phases $ for the P" decays and $ for the P" decays are 
measured relative to B^{B'^) — > p^yr*. The uncertainties are statistical only. 



Resonance 


Parameter 

A{NLL) 


Solution-I 
0.00 


Solution-II 
3.94 


Solution-Ill 
7.77 


Solution-IV 
10.57 


p-(770)A'+ 


FF (%) 


13.60 ± 1.24 

0.14 ± 0.06 

(fixed) 

(fixed) 


13.70 ± 1.25 

0.17 ± 0.06 

(fixed) 

(fixed) 


13.20 ± 1.09 

0.11 ± 0.06 

(fixed) 

(fixed) 


13.40 ± 1.27 

0.14 ± 0.06 

(fixed) 

(fixed) 


p'(1450)A'+ 


FF (%) 


4.66 ± 1.42 
0.14 ± 0.06 
1.63 ± 0.26 
1.63 ± 0.26 


4.13 ± 1.42 
0.17 ± 0.06 
1.41 ± 0.25 
1.41 ± 0.25 


4.61 ± 1.56 
0.11 ± 0.06 
1.64 ± 0.28 
1.64 ± 0.28 


4.16 ± 1.61 
0.14 ± 0.06 
1.39 ± 0.27 
1.39 ± 0.27 


p- (1700)7^+ 


FF (%) 


1.16 ± 0.69 
0.14 ± 0.06 
0.52 ± 0.40 
0.52 ± 0.40 


0.61 ± 0.52 
0.17 ± 0.06 
0.42 ± 0.51 
0.42 ± 0.51 


0.78 ± 0.64 
0.11 ± 0.06 
0.38 ± 0.53 
0.38 ± 0.53 


0.30 ± 0.43 
0.14 ± 0.06 
0.07 ± 0.78 
0.07 ± 0.78 


A'*+(892)7r- 


FF (%) 


5.52 ± 0.59 
-0.30 ± 0.11 
0.74 ± 0.36 
0.37 ± 0.36 


5.54 ± 0.61 
-0.30 ± 0.11 
0.66 ± 0.36 
2.58 ± 0.36 


5.92 ± 1.21 
-0.21 ± 0.11 
-3.10 ± 0.37 
0.36 ± 0.36 


5.88 ± 0.63 
-0.22 ± 0.11 
3.09 ± 0.36 
2.61 ± 0.35 


A:*"'(892)7r" 


FF (%) 

^cp 


4.53 ± 0.57 
-0.15 ± 0.12 
0.65 ± 0.29 
-0.00 ± 0.33 


4.61 ± 0.57 
-0.16 ± 0.12 
0.58 ± 0.30 
0.24 ± 0.35 


4.63 ± 0.59 
-0.15 ± 0.12 
0.34 ± 0.30 
-0.03 ± 0.34 


4.69 ± 0.58 
-0.15 ± 0.12 
0.25 ± 0.30 
0.19 ± 0.35 


(^^)r^" 


FF (%) 

-^cp 


23.60 ± 1.18 
0.07 ± 0.05 
-2.76 ± 0.25 
-2.60 ± 0.30 


24.90 ± 1.17 
0.02 ± 0.05 
-2.84 ± 0.26 
-0.50 ± 0.31 


24.90 ± 1.19 
0.11 ± 0.05 
-0.50 ± 0.32 
-2.60 ± 0.31 


26.10 ± 1.16 
0.06 ± 0.05 
-0.57 ± 0.31 
-0.45 ± 0.31 


(KnYo^n^ 


FF (%) 

-^cp 

¥ 


11.90 ± 1.11 
-0.16 ± 0.09 
0.37 ± 0.26 
-0.11 ± 0.27 


17.80 ± 1.24 
-0.43 ± 0.08 
0.29 ± 0.27 
0.26 ± 0.23 


16.60 ± 1.09 
0.17 ± 0.07 
0.20 ± 0.22 
-0.12 ± 0.28 


22.80 ± 1.17 
-0.14 ± 0.06 
0.11 ± 0.22 
0.26 ± 0.23 


NR 


FF (%) 

^cp 


5.90 ± 0.93 
0.07 ± 0.15 
1.00 ± 0.24 
1.15 ± 0.27 


3.98 ± 0.81 
0.64 ± 0.21 
0.91 ± 0.24 
-1.22 ± 0.34 


5.40 ± 1.02 
-0.04 ± 0.19 
-0.93 ± 0.26 
1.16 ± 0.29 


3.49 ± 1.09 
0.54 ± 0.22 
-1.04 ± 0.26 
-1.21 ± 0.34 


P\« 


FF (%) 


20.90 ± 0.85 


20.80 ± 0.85 


20.70 ± 0.93 


20.60 ± 0.86 


D-K+ 


FF (%) 


0.93 ± 0.23 


0.96 ± 0.23 


0.98 ± 0.23 


1.02 ± 0.24 
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VII. SYSTEMATIC UNCERTAINTIES 

Variations around the nominal fit are tried to study the dominant systematic effects, summarized in Ta- 
ble lVIl For each parameter of interest {FF, Acp, <&), the positive (negative) deviations from each effect are 
summed in quadrature to obtain total upward (downward) systematic errors (5+ ((5_ ) . Systematic effects are 
studied by varying the number of resonances contributing to the signal model, the lineshape parameters of 
the resonances in the signal model, the yields of the nominally fixed B-backgrounds, and the shape of the 
continuum Dalitz PDF. The intrinsic bias of the fit as measured in MC studies, is also included as a source 
of systematic error. 

• To estimate the contribution of other resonances, we fit the on resonance data with extended sig- 
nal models including one eitra-resonance in addition to those in the nominal signal model. The 
K^°{U30)n°, i4:2 + (1430)7r-, K*^{1680)tt° and i^*+(1680)7r- have been added to the nominal model, 
and fits with these resonances show some improvement in likelihood. In the best solutions obtained 
with these extended models the addition resonances did not significantly interfere with those in the 
nominal model. The variations of the physical parameters due to additional resonances are recorded 
as Dalitz Plot Model uncertainties in Table IVII 



• The variations of the physical parameters of the resonances in the nominal signal model are recorded 
as Lineshape systematic uncertainties. 

• Variations of the PDF shape parameters are recorded as PDF Shape Parameter systematic uncertain- 
ties. Specifically, mismodeling of the continuum square Dalitz plot PDF (Section V.B) is studied by 
recreating the PDF with numerous smoothing parameters and varying the amount of B-background 
subtracted from the toes sideband by 50%. A small difference in the shape of the TM-signal NN 
distribution between data and MC is also studied. 

• To estimate the Fit Bias uncertainties inherent in our fit technique, we record the fitted biases and 
spreads in fits performed on large Monte Carlo samples with both signal and background events 
generated with their nominal PDFs. 

• Each of the nominally fixed B-background yields is allowed to vary freely in a series of fits to data. 
The variations of B-background yields are recorded as B-background systematic uncertainties. 

VIII. SUMMARY 

We have performed an amplitude analysis of the S" -^ K^-k~tt^ decay. We have measured the CP- 
averaged fit fractions, CP-asymmetries and phases of the decay precesses to the intermediate states with 
p-(770)X+, p-(1450)if+, p-(1700)if+, ii:*(892)+'°7r-'°, (K7r)*+'°7r-'0. We find a satisfactory solution 
that provides a significant constraint on the phases of the resonances. For this solution, the CP asymmetries 
are consistent with zero in all quasi two-body channels. Three further solutions were found, though all had 
an NLL worse by 3.9 units, or more. Additionally, we measure the CP-averaged fit fractions for the decays 
5° -^ D°Tr° -^ X+tt-ttO and B° -^ D-K+ -^ K+Tr-Tr°. 
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TABLE VI: Summary of systematic uncertainties. 



Resonance 




Fit Fraction (%) 


A., 


$ 


$ 


^-(770)^-+ 


Dalitz Plot Model 


0.500 


0.003 


Fixed 


Fixed 




PDF Shape Parameters 


0.224 


0.005 


Fixed 


Fixed 




B Backgrounds 


0.071 


0.001 


Fixed 


Fixed 




Lineshapes 


0.229 


0.003 


Fixed 


Fixed 




Fit Bias 


0.015 


0.004 


Fixed 


Fixed 




Total 


0.598 


0.008 


Fixed 


Fixed 


p-{U50)K+ 


Dalitz Plot Model 


0.560 


- 


0.060 


0.060 




PDF Shape Parameters 


0.255 


- 


0.039 


0.039 




B Backgrounds 


0.038 


- 


0.014 


0.014 




Lineshapes 


0.232 


- 


0.088 


0.088 




Fit Bias 


0.170 


- 


0.022 


0.022 




Total 


0.680 


- 


0.116 


0.116 


p-{l700)K+ 


Dalitz Plot Model 


0.070 


- 


0.077 


0.077 




PDF Shape Parameters 


0.042 


- 


0.038 


0.038 




B Backgrounds 


0.009 


- 


0.009 


0.009 




Lineshapes 


0.216 


- 


0.120 


0.120 




Fit Bias 


0.110 


- 


0.037 


0.037 




Total 


0.256 


- 


0.152 


0.152 


K*+{892)n- 


Dalitz Plot Model 


0.070 


0.020 


0.112 


0.260 




PDF Shape Parameters 


0.154 


0.026 


0.021 


0.080 




B Background 


0.025 


0.004 


0.013 


0.009 




Lineshapes 


0.030 


0.006 


0.061 


0.147 




Fit Bias 


0.020 


0.004 


0.047 


0.038 




Total 


0.175 


0.034 


0.138 


0.312 


K'">{892)tv'-' 


Dalitz Plot Model 


0.200 


0.010 


0.065 


0.065 




PDF Shape Parameters 


0.128 


0.005 


0.020 


0.031 




B Background 


0.028 


0.002 


0.015 


0.012 




Lineshapes 


0.039 


0.004 


0.048 


0.065 




Fit Bias 


0.087 


0.005 


0.046 


0.012 




Total 


0.257 


0.022 


0.096 


0.098 


(^^)r 


Dalitz Plot Model 


1.200 


0.009 


0.050 


0.190 




PDF Shape Parameters 


1.166 


0.007 


0.022 


0.079 




B Background 


0.071 


0.001 


0.012 


0.015 




Lineshapes 


0.166 


0.004 


0.047 


0.121 




Fit Bias 


0.260 


0.006 


0.041 


0.030 




Total 


1.703 


0.014 


0.084 


0.218 


{K7T)t:' 


Dalitz Plot Model 


1.400 


0.033 


0.370 


0.225 




PDF Shape Parameters 


0.173 


0.016 


0.056 


0.032 




B Background 


0.071 


0.005 


0.025 


0.016 




Lineshapes 


0.224 


0.017 


0.071 


0.071 




Fit Bias 


0.300 


0.003 


0.044 


0.009 




Total 


1.461 


0.041 


0.384 


0.239 


NR 


Dalitz Plot Model 


0.240 


0.017 


0.119 


0.110 




PDF Shape Parameters 


0.744 


0.035 


0.106 


0.060 




B Background 


0.042 


0.003 


0.014 


0.014 




Lineshapes 


0.134 


0.019 


0.067 


0.117 




Fit Bias 


0.120 


0.003 


0.009 


0.034 




Total 


0.803 


0.044 


0.174 


0.175 


:d%" 


Dalitz Plot Model 


0.500 


- 


- 


- 




PDF Shape Parameters 


2.606 


- 


- 


- 




B Background 


0.150 


- 


- 


- 




Lineshapes 


0.071 


- 


- 


- 




Fit Bias 


0.073 


- 


- 


- 




Total 


2.660 


- 


- 


- 


D-K+ 


Dalitz Plot Model 


0.010 


- 


- 


- 




PDF Shape Parameters 


0.015 


- 


- 


- 




B Background 


0.002 


- 


- 


- 




Lineshapes 


0.013 


- 


- 


- 




Fit Bias 


0.001 


- 


- 


- 




Total 


0.022 


- 


- 


- 
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